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Abstract 

In symmetric groups, a two-sided cell is the set of all permutations 
which are mapped by the Robinson-Schensted correspondence on a pair 
of tableaux of the same shape. In this article, we show that the set of per- 
mutations in a two-sided cell which have a minimal number of inversions 
is the set of permutations which have a maximal number of inversions in 
conjugated Young subgroups. We also give an interpretation of these sets 
with particular tableaux, called reading tableaux. As corollary, we give 
the set of elements in a two-sided cell which have a maximal number of 
inversions. 
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1 Introduction 

In this article, we consider the symmetric group Sn- For w G S'„, the length of 
w, denoted i{w), is the number of inversions of w. 

The Robinson-Schensted correspondence 19 is the well-known bijection tt : 
w 1-^ {P{w), Q{'w)) between Sn and pairs of standard tableaux of the same 
shape (a partition of n). For each partition A of n, we denote by T'*' the set of 
all permutations which are mapped by tt on a pair of tableaux of shape A. In 
the Kazhdan-Lusztig theory, which we use in this article, the sets are called 
two-sided cells (see [1111221 IT]). 
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Our goal is to describe, for any partition A of n, the set T^^^ of elements of 
minimal length in T'*' and the set T^q^, of elements of maximal length in T'*'. 



For each composition c = (ni, . . . , n^) of n (with > 1), the Young subgroup 
Sc = Sni X • ■ • X Srik contains a unique permutation cTc of maximal length. It 
is well-known that cTc is an involution, called the longest element of Sc- Denote 
A(c) the decreasing reordering of c. It is well-known that two Young subgroups 

and are conjugated in Sn if and only if A(ci) = A(c2). 

Schiitzenberger |2] has shown that the map T i-^ wt — t^^^{T,T) is a 
bijection between the standard tableaux of shape a partition of n and the invo- 
lutions of Sn (see also |3j where another interesting description of this bijection 
is given). 

A standard tableau T is a reading tableau if it has the following property: 
for any 1 < p < n, either p is in the first line of T, or if p is in the i'^ line of T 
{i > 1) then p - 1 is in the {i - 1)"^ hne of T. 

As example, the column superstandard tableaux (which are tableaux num- 
bered from the bottom to the top of each column, from left to right) are reading 
tableaux. These particular tableaux are the transposed of those defined by 
Garsia and Remmel in Our main result is the following: 



Theorem 1.1, 

then 



Let X be a partition of n and be its associated two-sided cell, 



rain 



K|A(c) = A*} 

{wt \ T is a reading tableau of shape A}, 



where A* denotes the conjugate partition of A. 

Example. Consider the partition A = (3,2,1,1) of 7; A* = (4,2,1). Then the 
reading tableaux of shape A are 
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The right skew tableau is taken in the plactic class of the corresponding tableau 
viewed in the plactic monoid ^H] (see also [J])- The corresponding involutions 

are then 



wti = 4321657 = cr(4.2,i) 

= 1543276 = <y{iA,2) 
= 2137654 = cr(2,i,4) 



= 2165437 = cr(2.4,i) 



4321576 = 0- 



(4,1,2) 



= 1327654 = cr(i 2,4) 



and X 



(3,2,1,1) 



{o'(4,2,l), 0'(2,4,l), 0'(i^4^2), f(4,l,2), 0'(2,14), (T(i^2,4)}- 



Let A be a partition of n and T be a standard tableau of shape A. The 
Schiitzenberger evacuation of T, denoted by ev (T), is a tableau of shape A |2l)| 
(see also ^H! P-128-130]). The evacuation illustrates the conjugation and the 
left (and right) multiplication by the longest element (T(„) in Sn- In particular 
Q(w(T(„)) = ev {Q{wY), for any w e Sn, and T^a(^n) — '^(n)T^ 



Denote 



As i{a 



(«)J 



£{w), we obtain the following corollary: 



Corollary 1.2. Let X be a partition of n and be its associated two-sided 
cell, then 

TL. - R|A(c) = A} 

= {w I ev {Q{wy) = P{w(j(^n)) is a reading tableau of shape A'}. 

In the theory of Coxeter groups, the element dc is well-known as the unique 
element of maximal length in the set of minimal right coset representatives of 
Sc Chapter 2]. 

As a by-product of our proof, we obtain, in Section |3| that if w is an invo- 
lution, the Kazhdan-Lusztig polynomial Pe,w = 1 if and only if w is the longest 
element of a Young subgroup, where e denotes the identity of Sn- More pre- 
cisely, we show that an involution w avoids the pattern 3412 and 4231 if and 
only if w is the longest element of a Young subgroup of Sn ■ 



To our knowledge, our results are the first results relating the Robinson- 
Schensted transformation and the length function (number of inversions) of a 
permutation. There is no evident link between both. Our proof is non combina- 
torial and uses heavily the a— function of Lusztig ^1 El (questions about the 
leading term of Kazhdan-Lusztig polynomials and the a— function are heavily 



3 



studied, see for instance [^HlEl)- Trying to find a combinatorial proof (which is 
a challenge) leads first to the following difficulty: for any permutations w, x in 
a two sided-cell T^, there are permutations wi, . . . G such that wi = w, 
Wk = X and Wi+i is obtained from Wi by a Knuth or a dual-Knuth relation 
(see ^1[7]). But a permutation w may be 'locally minimal', that is whenever 
w (or w~^) admits a Knuth or a dual-Knuth elementary relation, this relation 
increases the length. The involution a = 632541 G 5*6 is locally minimal, but 
not of minimal length, in its two-sided cell. 

It would be interesting to find a purely combinatorial proof of the main 
result. It is apparently an open problem to read the length of a permutation w 
directly on the pair of tableaux Tr{w) (however, see J7j, where the author gives 
a way to read the signature on the pair of tableaux). Fortunately, the Lusztig 
a-function gives us a way to avoid this problem. 

2 Consequences of the main result 

We denote a partition of n by A = (Ai, . . . , Afc), with Ai > ■ • • > Aj. > 1. Our 
reference for the general theory of the symmetric group is |18| . 
For any partition A = (Ai, . . . , Afc) of n, we define, for i > 0, 

mi{X) ^ \{j I Aj = i}\ . 

The number •mi{X) is called the multiplicity of i in A (see [15)'). Observe that 
mi{X) = for all i > n, since A^ = n. It is well-known that the multinomial 
coefficient 

/ TOi(A)-f TO2(A) + --- + m„(A) \ 
\^ mi(A),m2(A), . . . ,m„(A) J 

is the number of compositions associated to A. Hence, we obtain the following 
corollary. 

Corollary 2.1. Let X he a partition of n, then 

I A I mi(A*) + m2(A*) + --- + m„(A*) \ 

I ™"l ^ mi(A*),m2(A*),...,m„(A*) 

which is the number of compositions c of n such that A(c) = A*. 

The minimal elements in two-sided cells are linked to another important 
number in combinatorics 

n(A) = E©. 

see [ISl p.2-3]. 

Corollary 2.2. Let X be a partition of n and write A* — (A^^, . . . , A^). Then 
iiw)=n{X) for all we 7;^„. 
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Proof. Let c be a composition of n such that A(c) = A*. Then £((Tc) = £{cr\ 

/A* 

Let Wi be the longest element of the Young subgroup Sx*, then £{wi) = 



Therefore 



i=i ^ ' 



since u\t — wi . . .Wk (seen as a word on the letters 1, . . . , n) and that the 
letters in Wi+i are greater than the letters in Wi. The corollary follows from 
Theorem O □ 

As in the case of minimal elements, we have the following corollaries: 

Corollary 2.3. Let X be a partition ofn, then 

I^A I toi(A)+TO2(A)H l-m„(A) \ 

I I ~ ^ mi(A),m2(A),...,m„(A) J ' 

which is the number of compositions c of n such that A(c) = A. 
Corollary 2.4. Let A = (Ai, . . . , Xk) be a partition of n, then 

\ /\ 



/or a/Z w £ T^'^ 



max • 



Proof. As ^(cr(„)) = and i?((T(„)w) = ^((^(n)) — ^(w), for any w G S*,!, the 

corollary follows from same argument than in the proof of Corollary 12. 21 □ 

3 Proof of Theorem 11.11 

The following proposition implies that 

{(Tc I A(c) = A*} = {wT I T is a reading tableau of shape A} C . 

Proposition 3.1. Let X be a partition of n; then the following conditions are 
equivalent: 

i) T is a reading tableau of shape X; 

ii) wt = CTc, where c is a composition ofn such that A(c) = A*. 

Proof. Recall that the longest element of a Young subgroup is an involution, 
since it is unique. 

Assume (i). As T is a reading tableau, if n is in the row Ti, one has 1 < p < 
n — 1 such that p + 1 is in the first row of T, p + i = n and p + j is at the end 
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of the row Tj, for all 1 < j < i. One applies the i first steps of the inverse of 
Robinson-Schensted correspondence, hence 

wt = wt' n ... p + 1. 

where T' is the standard Young tableau obtained by deleting p + 1, . . . ,n in 
T. Thus wt' is a permutation on the set {1, . . . ,p}- Observe that T' is also a 
reading tableau. The shape of T' is denoted by A'. By induction on n, wt' is 
the longest element of the Young subgroup Sc', where A(c') = A'. Then wt is 
the longest element of the Young subgroup Sc' x Si. Let c = {c',i); it is now 
easy to see that A(c) = A*. 

Conversely, let c = (ni, . . .Uk) and use induction and similar arguments with 
direct Robinson-Schensted correspondence on the permutation 

Wt = n-i ... 1 w' , 

where ni ... 1 is the longest element of the Young subgroup Sm and w' is the 
longest element of the Young subgroup Sn2 x • • • x Sn^, ■ □ 

Now, it remains to prove that {ctc | A(c) = A*} = 7^j„, to end the proof of 
Theorem O 

The Lusztig a-function: We consider the symmetric group Sn as a Coxeter 
system {W, S) of type An-i with W — Sn and generating set S consisting of the 
n — 1 simple transpositions n = (i, i + 1), where i = 1, . . . ,n ~ I. Then £{w) is 
also the length of w as a reduced word in the elements of S. A classical bijection 
between subsets of S and compositions of n is obtained as follow: Let I C S 
and S \ I — {Ti-^ , . . . , Tij. } with 1 < ii < i2 < ■ ■ ■ < ik < n — I. Set rii — ii, 
'^2 = *2 ~ *i + 1; ■ ■ ■ , TT-k = n ~ ik, then are non-negative integers. By this 
way, we have obtained a unique composition cj = (ni, . . . , Uk) of n associated 
to /. Moreover, 

Wl = Sn^ X ■■■ X Sn^. 

Therefore, as is well-known the Young subgroups of S'„ are precisely the parabolic 
subgroups of Sn (see ,9, Proposition 2.3.8]). 

Our basic references for the work of Kazhdan and Lusztig are , ^S] (see 
also 0)- We denote by < the Bruhat order on Sn- 

Let A = Z[gi/2,g-i/2] where q^^^ is an indeterminate. Let Ti. be the Hecke 
algebra over A corresponding to Sn- Let {Tw)w£Sn be the standard basis of TC 
and {Tju)w£S„ the basis defined as follows: 

f - n-fi-^y^T 

In Theorem 1.1], Kazhdan and Lusztig have shown that there is a basis 
{bw)w£Sn of called the Kazhdan- Lusztig basis, such that 

^ ^(-l)^(»)-^fe)g(^(»)-^(^))/2p,,„(5-i)f„ 
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where Py^^j G A are the Kazhdan-Lusztig polynomials. Moreover, they have 
defined three equivalence relations on Sn, with equivalence classes that are called 
left cells, right cells and two-sided cells. In our case, the following result of Vogan 
and Jantzen result on Sn ^1 122 gives the link with the Robinson-Schensted 
correspondence (see also pP): the set is a two-sided cell for all partitions A 
of n; and any two-sided cell of Sn arises by this way. 

Following Lusztig |14[I15| . let h^.y^w be the structure constants of the Kazhdan- 
Lusztig base {bw)wew, that is 

bxl^y — ^ ^ l^x,y,w l^w • 

Denote S{w) the degree of the Kazhdan-Lusztig polynomial Pe,™ as a poly- 
nomial in q. Write u — c^l"^ . Let a{w) be the smallest integer such that for 
any x,y & Sn, u'^'^^^ hx,y,w & A'^ , where A'^ = Z[u] (this is well defined for any 
Weyl group) . In El ) Lusztig has shown the following properties about the 
a— function: 

a) a{w) < £{w) - 2S{w) Section 1.3]); 

b) The a— function is constant on two-sided cells ([2! Theorem 5.4]). 

c) For any I C S, a{acj) = £{crc,) ([13 Corollary 1.9 (d) and Theorem 1.10]). 
In other words, for any composition c of n, a(o'c) = ^(fc). 

d) Let T> = {w € W \ a{'w) = ^(w) — 25{w)}, then each element in V is an 
involution, called a Duflo involution f |15[ Proposition 1.4]). In symmetric 
groups, all involutions are Duflo involutions. Indeed, each left cell contains 
a unique Duflo involution left cells are precisely coplactic classes 
(the sets of permutations having the same right tableau under tt, see for 
instance 1 ), and each coplactic class contains a unique involution. 

Let A be a partition of n and T'^ be its associated two-sided cells. Properties 
(b) and (c) imply that a\ := a{(7\t) = a{w), for all w E . Therefore, by (a), 

£{ac) = ax = a{w) < £{w), 

for any w e T^. Thus 

{a, I A(c) = A*} C r^„. 

Now, let w e 7^i„, then a{w) = ax = £{(Jxt) = £{w), since crx* G 
Property (d) implies that w is a Duflo involution and S(w) = 0. 

By Proposition 13.11 CTc G T"^ implies A(c) = A* Therefore, Theorem 11.11 is 
a direct consequence of the following result, which gives a surprising criterion 
about the degree S{w) of the Kazhdan-Lusztig polynomial Pe.w, for w G S'„ an 
involution. 

Proposition 3.2. Let w E Sn, then the following conditions are equivalent: 

i) w is an involution and S{u)) = 0; 

ii) w = ffc, for some composition c of n. 
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KL Polynomials and smoothness of Schubert Varieties: We say that 
a permutation w G 5„, seen as a word w ~ xi . . .Xn, avoids the pattern 4231 
(resp. avoids the pattern 3412) if there isnol<i<j</c<^<n such that 
xi < Xj < Xk < Xi (resp. Xk < xi < Xi < xj). In other words, there is no 
subword of w with the same relative order as the word 4231 (resp. 3412). 

Here, we link these definitions with Kazhdan-Lusztig polynomials by the 
way of the following well-known criterion: Let w £ Sn, then 

(o) Pe = 1 w avoids the patterns 4231 and 3412. 

Indeed, on one hand, Lakshmibai and Sandhya have shown that a Schubert 
variety X{w), w G S'„, is smooth if and only if vu avoids the pattern 3412 and 
4231 ([12 or see ^. Theorem 8.1.1]). 

On the other hand, Deodhar 6 has shown a useful characterization of the 
smoothness by the way of Kazhdan-Lusztig polynomials: Let w e S'„ then 
Pe,w = 1 if and only if X{w) is smooth. 

Proof of Proposition \'S.2\ By the above discussion, Proposition 13.21 is a 
direct consequence of the following lemma. 

Lemma 3.3. Let w £ Sn an involution, then the following statements are 
equivalent 

i) w avoids the patterns 4231 and 3412; 

ii) there is a composition c of n such that w = Uc; 

Proof, iii) =^ (i): write c — (ci, . . . ,Cfc). If fc = 1 then CTc = cr(„) avoids the 
patterns 4231 and 3412. If /c > 1 then Cc is the image of (f7(ci ),..., cr(c^)) 
under the canonical isomorphism between 5*^ x • • • x Sc^. and Sc- Conclude by 
induction on n. 

(i) =^ (a): one sees w — xi . . . Xn as a word on the letters 1, . . . , n. 

One proceeds by induction on n. Therefore, one may suppose that (i) (ii) 
for all proper Young subgroups oi Sn- If n < 4, it is readily seen. Suppose n > 4. 

If = 1, then vu £ Si X Sn-i, and the lemma follows by induction. 

If n > a;i = p > 1, then Xp = 1 and I < Xi < p, for all I < i < p. Otherwise, 
there is 1 < i < p such that Xi > p. In other words, there is 1 < i < p < Xi such 
that Xp — I < Xxi = i < xi — p < Xi, that is, w has the pattern 3412 which is 
a contradiction. 

Hence w £ Sp x Sn-p and the lemma follows by induction. 

If xi — n, then Xn — 1 one just has to show that w — wq. Otherwise, there 
isl < i < n— \ such that Xi < Xi+i (since ii i = 1, xi = n < X2 and if i-l-1 = n, 
Xn-i < Xn = 1 which are contradictions). Thus there isl<i<i + l<n 
such that Xn < Xi < Xi^i < xi, that is, w has the pattern 4231 which is a 
contradiction. □ 
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